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This technical inetnorandum has been prepared as a locumpntati'Xi of the 
objective procedures developed at the Laboratory for Atmospheric Sciences to 
edit the PC3GE Level Il-b data. The document should be a useful reference 
for scientists conducting observational and model studies with the PCXjE data. 


Wayman E. Baker 
1 Septembt^r 1981 


ii 



ACXNOWLEIXjMENTS 


We gratefully acknowledge the encouragement and support of Dr. Halem and 
the helpful comnents of Dr, E. Kalnay. Vife also benefltted from discussions 
with Drs. T. Kaneshige, G. DlMego, A. Hollingsworth, P. Julian, and F. Mosher. 

The report was typed by Ms. L. Thompson and Ms. J. Reckley, and Ms. L. 
Rumburg drafted the figure. 


iti 


LIST OF ACRONYMS 


AIDS 

- 

Aircraft Integrated Data System 

AIREP 

- 

Aircraft Report 

ASDAR 

- 

Aircraft to Satellite Data Relay 

CMS 

- 

Conversational Monitor System 

aX)AR 

- 

Coded AIREP 

OOLBA 

- 

Constant Lev*?"' Balloon 

DRIBU 

- 

Drifting Laoy 

DSI 

- 

Data Source Index 

ECMWF 

- 

European Center for Medium Range Weatner Forecasts 

FTiGE 

- 

First GARP Global Experiment 

FORTRAN 

- 

Formula Translation 

GARP 

- 

Global Atmospheric Research Program 

GLAS 

- 

GSPC Laboratory for Atmospheric Sciences 

um 

- 

Indicator for the Data Processing Technique 

IT 

- 

Instrument Type 

LI MS 

- 

Limb Infrared Monitor of the Stratosphere 

MV'S 

- 

Multiple Virtual Storage 

NI’,SS 

- 

National Environmental Satellite Service 


- 

Nc'itional Meteorological Cfmter 

NOAA 

- 

National Oceanic and Atmospheric Administration 

SAKAI) 

- 

Satellite Radiances 

SAT'M 

-• 

Satellite Temperature 

SA’IV )H 

- 

Sate! Lite ()bs»'rvation 

.SOI' 

- 

Sf)ecial Observing Per loti 

SI'CF 

— 

Subjective Pressure Confidence Factor 


iv 



LIST OF AOtONYMS (OontlniMd) 


TSWD 

TKKUS 

VTW 


Type of Satellite Wind Derivation 
Tropical Wind Observing Ship 
Vertical Tanperature Profile Radiometer 


V 



TABLE OF (CONTENTS 


Page 

Foreword 11 

Acknowledgments Ill 

List of Acronyms Iv 

1. Introduction 1 

2. PGGE Level Il-b Data Set Organization 2 

3. Modifications to the Database by Data Type 4 

3.1 Kawinsonde Data 4 

3.2 Pilot Balloon i:)ata 4 

3.3 'HVOS Radar Sounding Data 4 

3.4 TV/OS NAvAll) Sounding Data 4 

3.5 Aircraft Dropwindsonde Data .... 4 

3.6 Constant Level Balloon Data 4 

3.7 Experimental Satellite Stratospheric Sounding Data (LIMS) 5 

3.8 Aircraft ’lata - ASDAK 5 

3.9 Aircraft Data - AIDS 5 

3.10 Aircraft Data - Conventional (AIREP and CODAR) ... 5 

3.11 Manual and Automatic Surface Land Observations ... 5 

3.12 Surface Observations fron Fixed and Mobile Ships ... 5 

3.13 .S'lrface t'bservations fnjm Environmental Buoys .... 5 

3.14 Satellite Sounding Data 5 

3.15 S;i tr 1 1 i te Cl ea r-Uad i ancf ■ D.« ta 6 

3.16 Sab'llite Cloud-'track Wind Data 6 

3.17 S.atellite Cloud Data 8 

3.1H Satellite Sea Surface Tc?nrierature Data H 

3.19 Oceanographic Data 8 

vi 


3.20 DriftlnK Buoy Data B 

3.21 Sunmarv of the Database Modifications during SOP-1 aiKl 2 9 

4. Automated Editing Procedures 10 

4.1 Program Orgarization 10 

4.2 Permanent Data Sets 11 

4.2.1 Sweden Level Il-b Main Data 11 

4.2.2 Wisconsin Reprocesiied Japanese Cloud-Motion Winds 11 

4.2.3 Edited Level Il-b Main Data 11 

4.2.4 Scripps Topography 11 

4.2.5 Coordinate Corrections 11 

4.2.6 Restart File . . .' 12 

4.2.7 Namelist File 12 

4.3 Program Execution 12 

4.4 Flow Diagram of the Program Logic ........ 13 

5. Summary 20 

References 21 


vli 


1 . INTRODUCTION 


In any study which utilizes atmospheric observations, an important step 
is a check on the reasonableness of the data. The database modifications 
doci'/nented here should not be considered as a substitute for the usual data 
checks (e.g. hydrostatic balance). Rather, they should be viewed as a supple- 
ment to th 2 usual editing procedures. 

In developing the FX)RTRAN program to perform the modifications to the 
database, we relied on the previous work and experience of a number cf 
individuals. P. Kallberg of KCMWF provided a list of stations known to have 
had incorrect geographical locations as well as numerous other corrections. 
Hawinsonde thermistor corrections were performed with routines provided by 
G. Cost^-llo and J. Laver of NMC. The TIROS-N temjjerature soundings file was 
ch€?cked against a set of problems documented by NEvSS. Oceanic microwave 
retrievals fr(xn TlROS-N with precipi table water contamination were eliminated 
following the suggestion of Riillips (1980). 

Section 2 outlines the POOR Level Il-b data set organization. A detailed 
description of the modifications made to the database by data type is presented 
i'- Section S. In Section 4, the FORTRAN program to perform the editing is 
dosfribeil. A sumnp.ry follows in Section 5. 
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2. FXiGE LBVEL II-Ti DATASET OHGANIZATION 


The international exchange format for the level Il-b data specifies 
eight distinct data fomuts for encoding the complete set ol data t\*pes 
collect(>^' 'Juring FGGE. These formats, and the correspuodin^ data types, are 
described in 'ftible 1. 


2 


Table 1. Level Il-b data types associated with the international t'lpe exchan^p 
formats (Staff of the GARP Activities and the Participants in the RX'iF 
Data Managenent Scheme, 1978). D6I denotes the Data .Source Index. 











3. W)DIFICATIONS TO THE F>ATAHASE HY DATA TYPE 


Iti this s(H:tlon, the modifications made to the databas<> by data type 
for SOP-1 (5 Jamjary 197if thr«igh 5 llarch 1979) and SOP-2 (1 May 1979 tfirounh 
^<0 June 1979) are dc?scribe«1. Duplicate reports were ellmlaited from all 
data types. Fixed reporting statloris were checked against a list stations 
(provided by P. Kallberg) known to liave had at least one occurrence of an 
lncoriv''.t geographical location. Erroneous locations were corrected. In 
atldition, the data were* sorted within each file by latitude and longitude. 

3 . 1 H awinsonde Data 

Hawinsonde height and tempera tur*i proliles were cjorrected at levels 
abovi* i;X) mh for the effects of solar radiation. The corrections were com- 
puted HS a function of pressure level, solar elevation angle, and instrument 
type (Vcln*uilf et al. , 1979) with routines provided bv G. Costello and J. 
I^iver of NMC. Longwave corrections were aiiplled above 10 mb. 

USSR wind repirts with wLndspeeds greater than 100 ms”^ wt»re eliminated. 

3 .2 'h lf.)t balloon Data 

N»^ special treabr ^nt whs perfomt-d. 

3 .3 TW<*S Radiir Soun ding D ata 

’•J') MVTlil trptttmen^ was performed. 

3.«! 'rWM S N.WAID Stauidlog D ata 

V> Sf>v al tr»*iiment was performed. 

3 . h A. i renit Drupwl nd sonde IX tH 

N. • K5<.*cra] tO'Miment wu’- jierfonrtHi. 

.t) ( v mstan i ]g* ^l b a lloon 

sp"clii treavmtnt was pt-rioraeil. 


a 


3.7 Experimental Satellite Stratospheric Sounding Data 


No special treatment was performed. 

3.8 Aircraft Data - ASDAR 

An erroneous Data Source In<iex was nodified to the correct value of 21. 
ASDAR reports were identified by a trailing "z" in the sin character indenti 
ficatlon. Multiple wind reports with identical latitude, longitude, observa 
tion time, and quality marks indicating correct data were elimi>iated. 

3.9 Aircraft Data - AIDS 

R<?ports with a latitude and longitude of 0.0® were eliminated. Multi- 
ple wind reports with identical latitude, longitude, observation time, and 
quality marks Indicating correct data were eliminated. 

3.10 Aircraft Data - Oonventlonal (ATHPP and CXX)AR ) 

Multiple wind n*ports with identical latitude, longitude, obsi*rvation 
time, and quality mnrks indicating correct data wt^re eliminated. 

3 , ’ ’ Mun ual and A.itomatic Su^-face land Observations 
No sjiecia'’ tm^atment was pcrfoniv'd. 

3, . ! 3 Su r f rvat ion s fmm Fixed and Mobile Stiips 

ship locations w«^n* verified against the Scripps 1“ x 1® topography 
All TMjorts with l*x!ations (W**r land wer»^ eliminated. 

3.13 St irfa..e (»)ser\-at lons fnim t->ivimnnental Huoys 
No six?clal trt*atmt*nt was performctl. 

3 . M s aK’l 1 1 te SrM j ndlng Data 

T!ie follfjwing corrections were nude to TIKOS-N reports as sugi'esti^d bv 


H. (irtH*n of NKSS: 




ORIGINAL PA® ® 

OF POOR QUALITY 

(a) All tropopause parameters were deleted for SOP-1 and 2. 

(b) All ozone parameters were deleted during SOP-1 and 2. 

(c) All precipi table water parameters were deleted from 5 January through 
21 January and frvxn 1 March through 5 March. 

(d) All layer mean temperatures above 100 mb were deleted for obseirvations 
polewaid of 74“ from 5 January through 11 February and frXDm 1 March 
through 5 March. 

(e) Complete temperature profiles were deleted from 1 May through 5 May, 
if the observations were between 60“ S to 75“ S and the MSU channel 4 
temperature was less than 219 K. 

(f) Complete temperature profiles were deleted from 1 May through 26 
May, if the observations were between 55“ S to 60“ S and the MSU 
channel 4 temperature was less than 215 K. 

TlHOl-N rnicrowave retrievals with precipi table water contanination were 
eliminated following tlTe suggestion of Phillips (1980). Microwave retrievals 
Wi re not checked at 1200 and 1800 GMl' 25 February 1979 because t‘u> T1K(XS-N 
retrievals and the radiances could not be collocated. Geopc^tential height 
tlTicknesses were generated by a procedure provided by NMC. 

Nc' changes were made to the VTPP soundings from NOAA-5. 

0 . 15 Satellite Qe ar-Radi a nce Data 

nata type was not processed. 

3 . 16 S atelli te C loud-Track kind Data 

The oioud-track wind data file is summarized In Table 2. The Wisconsin 
.vpror< ;ssf»d winds the Jaiumcse s^itellite wi‘re merged with thf^ aatellit>‘ 
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TtM* IHUO GMT 16 January WlsocMln 'vlnda from GOES West wer« deleted 
bocausp Hnnn cumulus level winds were assigned to the cirrus level. The 
Instrument Type for NESS East and West cloud- track «rlnda was incorrectly 
(ieslKnated as 59 during part of S0I>-1. We re-assigned the NESS cloud-track 
wind Instrurm»nt type to 60 (QOES West) for reports with a longitude > 255* E 
and to 61 ((XU'S West) for reports with a longitude < 255* E (see Table 2) 

3.17 Satellite Cloud-Data 

Data type was not processed. 

3.18 S atellite 8ea Surface 'Demperature Data 
Data type was not processed. 

3.19 Oc€>anographic Data 

Data type was not processed. 

3.20 drifting Buoy Dat a 

No special treatment was performed. • 



3.21 Sunmary of the Database Modifications during SOP-1 and 2 

Table 3 contains the typical corrections and deletions made to the 
database during SOP-1 and 2, respectively. The number of changes indicated 
for thf' upper-air file does not include corrections made for radiation ef- 
fects on the rawinsonde temperature and heights. The changes indi<mted 
for the satellite soundings include only the corrections made for pre- 
cipi table water contamination and duplicate reports. 


Table 3. Modifications made to the PC3GE Il-b database during SOF^l from 
0000 GMT 12 January to 0000 GMT 19 January by file type. 


Data 

Format 

Time 

Upper- 

Air 

Arcrf t. 

Surface 

Sat. 

Snding. 

B 


Oceano- 

graphic 

Drift. 

Buoy 

1/12/oz 

10 

79 


94 


532 

0 

0 

6z 

3 

75 


93 


3 

0 

0 j 

1 127. 

12 

83 

32 

70 

0 

490 

0 

0 1 

IKz 

1 

114 

34 

84 

0 

492 

0 

0 

1 / 13/oz 

13 

76 

34 

58 

0 

519 

0 

0 

6z 

3 

105 

37 

91 

0 

0 

0 

0 

12z 

11 

29 

42 

49 

0 

366 

0 

0 

1 IHz 

1 

53 

27 

105 

0 

377 

0 

0 

1 l/14/oz 

11 

22 

26 

92 

0 

518 

0 

0 i 

1 6z 

0 

80 

30 

100 

0 

14 

0 

0 1 

1 12z 

10 

69 

35 

74 

0 

418 

0 

0 

■ ] Hz 

0 

168 

30 

111 

0 

420 

0 

0 

! 1/15/oz 

15 

125 

34 

20 

0 

493 

0 

0 

>r/. 

0 

177 

27 

105 

0 

4 

0 

0 

’2/ 

10 

57 

39 

88 

0 

432 

0 


IHz 

0 

65 

24 

133 

0 

373 

0 

0 1 

1 1/lb/oz 

15 

55 

33 

99 

0 

585 

0 

0 

1 6z 

2 

1(X) 

36 

90 

0 

2 

0 

0 

i 127. 

10 

67 

38 

85 

0 

415 

0 

0 

; LH/. 

2 

144 

30 

74 

0 

339 

0 

0 

1 I/17/OZ 

11 

64 

36 

21 

0 

515 

0 

0 

1 Hz 

3 

85 

43 

91 

0 

2 

0 

0 

j ]2z 

13 

61 

43 

78 

0 

425 

0 

0 1 

IHz 

1 

122 

41 

92 

0 

383 

0 

0 1 

1/18/oz 

15 

107 

32 

104 

0 

368 

0 

0 1 

Hz 

•1 

82 

37 

95 

0 

0 

0 

0 ; 

127 

11 

59 

34 

78 

0 

365 

0 

0 1 

, ‘hz 

9 

39 

42 

103 

0 

337 

0 

0 

1/19/OZ 

13 

112 

37 

78 

0 

331 

0 

0 
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». AiaXMATbP hBITlNG WKX’FIHJHHS 


A KIKTKAN piMKmn vwis prepared which implements the incxU float ions to tlw» 
dfita (i»‘scrlbecl In Section 3. Tlie subsequent sections describe this program 
as *ell aj the daL*i file structure. 

4 . 1 Prry:n un Organization 

The pnx»*ani has be^'n cieveloped, tested, and executed on the Amdahl 470/Vrt 
under i:ontn''l of the Co*wersatic'nal M«’>nitor System (tXS). Ttie HWlllAN and 
ass»*nbler code wsides in six local files: 

• lU AHliS i;^.UI''HlVK - wtnstltutes U» driver portion of Uie pnvrair; 

establisiies the prosier calling sequence for each 
spivific type of data. 

• Ht'\h’US i::uWHlTK - lv»rfonns retjuired correctiims to t'Hch tvix' of 

data, «*ncodes the editini file and writes to output 
tajte. 

• IK'AHi'S 12HUKAU - Meads tl»e input tapes and unpav'ks tiie iv|V)rts, one 

file at a tiiw*. 

• A AKUS imtliTIl. - tl>nLains auxi liary routines that jjerionn tunrtions 

such as sortinR, prlmitivi' encodiiH';. and til.* copyini?. 

• IK’AKl’S 12HHSTAK - l>*rformi; all functions P'late<l io rj'Start <’oi»ditions 

anti issues twsHagos for t^ipe motints. 

• (VS HLdTlNi-iP - iXu-fonns primitive ta|>> liandlin^ furattit^ns (i.e. 

st nsr ‘twitch, rend lahc*l , unU»d, errr>r t»st, and 
deuicht . 

The first l*ve files testde m tlie {'AHUM iicciHint iixi eon ain '^>KTHAN 
e>xlt‘ <»nly. Tii* last file resides *n tlie HKKlNl*Ai account atui conrulns lyjih 
Wtl'TilAN and assembler eole. 

U 



4.2 Ftermanent Data Sets 


The program requires the contents of six data sets of which two are input 
tapes, one is the output tape, and three are disk files. 

4.2.1 Sweden Level Il-b Main Data 

The format of these tapes is described in Appendix 10 of Staff of the GAHP 
Activities and the Participants in the FXjGE Data Management Scheme (1978). 

4.2.2 Wisconsin Heprocessed Japemese Cloud-Motion Winds 

The format of these tapes is described in Appendix 10 of Staff of the GARP 
Activities and the Participants in the FXXjE Data Management Scheme (1978). 

4.2.3 Edited Level Il-b Main Data 

The fonnat of these tapes is described in Appendix 10 of Staff of the GARP 
Activities and the Participants in the FGGE Data Management Scheme (1978) with 
tile following exceptions: 

• The test file is :.ot included. 

• Tie tape-header file is not included. 

• Sa*:eiiite clear radiance (IXSI = 51), sea surface temperature (DSI = 63), and 
ofvipojrraphic data (TXSI = 71, 72) are not included. 

4.2.'' ^ ipps Topography 

I'hts :ile contains global terrain height data on a 1“ grid prejiared at the 
Scci’.n-; Institution of Oceanoj^raphy us described in Gates and Nelson (1975). 

Tfie data reside on MVS disk and are cataloged in Q^I .JA. SCRIPS. T0PUG.YR79. 

1.2.9 (i xjrdinate Correc:tions 

I'h s t i’.o contains the correct oxirdinates (provided by P. Kallberg) 
l.)r .! suhset o'j stations that are known to have had at least one occurence 
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ot an Lnc:orrect geagraphloal location. The data reside on CMS disk under 
the name LI*A’tL2B OORRBCTN. 

4.2.6 Hestart File 

Tlw? restart file contains the counts for processed files on the ttk' 
input tapes and the output tape. It resides on MVS disk and is cataloged 
. inder (JWS .CAHIJS . LEV KL2B .RESTART. DATA. 

4 .2 .7 Name list File 

Tins file contains a namelist definition for the number of tJities and their 
voluin>-serial numbers. It resides on MVS and is cataloged under GWS.CAKUS. 

I .hVKJ yM .NAMELIST . DATA . 

4.S i TcTgran b 'x ecution 

Fxerution is accomplished by invoking th«' 1^BT2 EXHIC r»-*sitling in tlie 
r\KUS Mcenunt . The pn^gnun requiix»s 3.5 rw^abytes of ia?morv and six temiv*r:iry 
drtfi sets. 


4 . 1 Flo w Diagr am of the Program Logic 

Tht following seven diagrams (Fig. la-lg) illustrate the flow of the 


pi\-^ram logic. 
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READ 

SCRIPPS 1° X 1° TOPOGRAPHY FILE; 
COORDINATE CORRECTION FILE 



READ 

RESTART FILE AND 
POSITION ALL TAPES 


♦ 

READ HEADER RECORD FROM 
UNEDITED LEVEL II“B TAPE 




READ FILE (OR REPORT 
IN CASE OF DATA TYPF 6 ) 
TO CORE 



1 


WRITE FILE TO 
UNIT 1 9 



READ FROM UNIT 19 
ONE REPORT AT A TIME AND 
UNPACK ACCORDING TO TYPE 


I 


FILES THAT ARE NOT 
PROCESSED INCLUDE 
SATELLITE SEA 
SURFACE TEMP. (ds1=63) 
AND OCEANOGRAPHIC DATA 
(DSI=71 THROUGH 77) 


SORT IN 

GEOGRAPHICAL ORDER 


Fig. la. Flow diagram of the program logic 











DATA TYPE 1 "UPPER AIR 


CHECK FOR DUPLICATE 
REPORTS 


DELETE REPORT 
IF FOUND 



Fig. lb 
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DELETE REPORT 
IF FOUND 


DELETE REPORT 
IF FOUND 


SET DSI TO 21 
IF FOUND 




KD 


bC 














ORIGINAL PAGE IS 



♦ 


I 

I ENCuDE Pt.'OKT AND 

1 ACC"MUL/TE BLOCK 


I OUTPUT TO TAPE '^EN 

I BLOCK IS FILLED 



Fig. l.i 
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DATA TYPE 6“SATWIND 


ORIGINAL PAGE IS 
OF POOR QUALITY. 


i 

1 

ir SATWIND FILE EXHAUSTED^ 

IF WISCONSIN REPROCESSED 

1 

READ WISCONSIN HEPNuCESSED 

'WIND TAPE IS EXHAUSTED/ 


WIND TAPE 

RETURN 


^:heck for duplicate 

REPORTS 


DELETE REPORT 
IF FOUND 


CHECK FOR WISCONSIN 
GCE3 WEST REPORT ON 
1300 GMT IGjaN. 1?79 


DELETE REPORT 
IF POUND 


HECK FOR NESS REPORT 
WJTM INCORRECT iNMRUMENT 
TYPE DESIGNATION 


CORREC"^ instrument TYPE 
AND split report NTO 
east and WES' FI..ES 


LNCUbL REPORT 
AND AtCUMUij;TE 
blocl 


output to tape 

WMEN iiLCCK IS filled 
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Fig. Ig 
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1 : j ORIGINAL PAGE IS 

‘ OF POOR QUALITY 

i 5. Su-MMARV 

The objective procedures developed for editing tlie PQGK Level 
1 l-b data have been described. The edited databas^^ is probably the 

I 

iiosi iiceurate one available thus far for PCX3E SOl»-l and 2. 'tost of 
rhp nxxilfications described in this report will be performed or* the 
Fi.ml L/:*vel Il-b database new in iJireparatiOH in Sweden and sciieduled 
to OP aelLvered to the World Data Centers in 1983 (S. Orrhagen, i>ir- 
sonal '/munication;. Other data sets such as TIHOS-N retrl*-vals fn»n 
the KiCL Special Effort will also be included in the Final r'araixisf. 
The editing procedures will be modified to aceo»rmodate the additional 
dva sets. 
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